per #2047 (comment)

What about dropping seeding setuptools and wheel on Python 3.8-3.11? I think it would be better if users specify every package they actually need (ideally via pyproject.toml), and they already have to do this to support 3.12+. If we did that, we could drop seeding anything into the venvs, which would be simpler and faster.

In fact build virtual environment already had dropped seeding those in v2.17 (#1725) but they were still seeded in the test virtual environment.